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Improvement /Extension of Modular Systems as Combinatorial Reengineering (Survey) 
Mark Sh. Levin * 



The paper describes development (improvement /extension) approaches for composite (modular) sys- 
tems (as combinatorial reengineering). The following system improvement/extension actions are consid- 
ered: (a) improvement of systems component(s) (e.g., improvement of a system component, replacement 
of a system component); (b) improvement of system component interconnection (compatibility); (c) 
joint improvement improvement of system components(s) and their interconnection; (d) improvement of 
system structure (replacement of system part(s), addition of a system part, deletion of a system part, 
modification of system structure). The study of system improvement approaches involve some crucial 
^H , issues: (i) scales for evaluation of system components and component compatibility (quantitative scale, 

ordinal scale, poset-like scale, scale based on interval multiset estimate), (ii) evaluation of integrated 

r/. , system quality, (iii) integration methods to obtain the integrated system quality. 

The system improvement /extension strategies can be examined as seleciton/combination of the im- 
provement action(s) above and as modification of system structure. The strategies are based on combi- 
natorial optimization problems (e.g., multicriteria selection, knapsack problem, multiple choice problem, 

^ , combinatorial synthesis based on morphological clique problem, assignment /reassignment problem, graph 

recoloring problem, spanning problems, hotlink assignment). Here, heuristics are used. Various system 
improvement/extension strategies are presented including illustrative numerical examples. 

Keywords: modular systems, system design, systems engineering, engineering frameworks, combina- 
Ji ' torial optimization, combinatorial reengineering, networked systems, heuristics 
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1. Introduction 

In recent two decades, the significance of system reengineering (i.e., issues of systems redesign, rebuilt, 
improvement, upgrade, extension) has been increased (e.g., |27I28I31I34I42I54| ). This paper addresses 
systems development schemes (i.e., improvement/upgrade, extension) for composite (modular) systems 
(as combinatorial reengineering). Generally, the system improvement process is the following: 

Initial system(s) => Improvement process => Resultant (improved) system(s). 

The systems approaches can be considered as follows: (a) improvement of systems components and/or 
their interconnections, (b) improvement /extension of a system structure, (c) "space" (e.g., geographi- 
cal) extension of a system as designing an additional system part, and (d) combined system improve- 
ment/extension. 

A general approach to system development consists of the following (Fig. 1): 

1. system improvement or modification (e.g., by components, by component interconnection, by system 
structure); 

2. system extension as designing an additional system part and its integration with the basic system. 



Basic system: ^\ Additional system part: 

structure, components, structure, components, 

component interconnection^ component interconnection 



Fig. 1. System and additional part (34] 

Fig. 2 depicts a hierarchy of general system improvement/development activities: (i) improvement of 
basic system, (ii) extension as designing of an additional system part, and (iii) coordinated improvement 
of basic system and designing an additional system part. 

The set of basic system improvement/extension actions is the following: (a) improvement of systems 
component(s) (e.g., improvement of a system component, replacement of a system component); (b) 
improvement of system component interconnection (compatibility), (c) joint improvement improvement 
of system components (s) and their interconnection; (d) improvement of system structure (replacement of 
system part(s), addition of a system part, deletion of a system part, modification of system structure). 

The system improvement/extension strategies are based on seleciton/combination of the improvement 
action(s) above (including modification of system structure). The strategies consist of combinatorial 
optimization problems (e.g., multicriteria selection, knapsack problem, multiple choice problem, com- 
binatorial synthesis based on morphological clique problem, assignment/reassignment problem, graph 
recoloring problem, spanning problems, hotlink assignment) (e.g., [4I5I17I2 2 24 33 57 ). Here, various 
algorithms (including heuristics) are used. 

Note, system improvement /extension approaches involve some system evaluation crucial issues: (i) 
scales for evaluation of system components and component compatibility (quantitative scale, ordinal scale, 
poset-like scale, scale based on interval multiset estimate) (ii) evaluation of integrated system quality (i.e., 
scale/space of system total quality) , (iii) integration methods to obtain the integrated system quality. 



This paper is research survey. Various system improvement /extension strategies are presented. Special 
attention is targeted to networked systems. Numerical examples illustrate the described approaches. 
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Fig. 2. Hierarchy of system development actions 



2. Four System Improvement Situations 

2.1. Basic System Improvement Situation 

The basic system improvement situation is depicted in Fig. 3 (one initial system and one resultant 
improved system). 
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Fig. 3. Basic system improvement [28131134] 

The following special cases can be considered for the above-mentioned basic system improvement 
situation (Fig. 3): 

Special case 1. Improvement of systems components: (1.1) improvement of system elements, (1.2) 
improvement of system elements interconnection (i.e., compatibility), and (1.3) joint improvement of 
system elements and their compatibility. 

Special case 2. Improvement as modification of system structure: (2.1) extension of system struc- 
ture (i.e., addition of a system structure part), (2.2) modification system structure as deletion a system 
structure part, (2.3) modification of system structure (i.e., transformation: addition/deletion of elements, 
addition/deletion of element interconnections), and (2.4) joint case (i.e., deletion of a system part struc- 
ture and addition of a system structure part, modification of system structure). 

Special case 3. Extension of a system as designing an additional system part (i.e., additional system 
structure part and additional system elements). 

Special case 4- Combination of the above-mentioned cases. 

2.1.1. System Improvement /Modification 

In general, system improvement/modification processes are based on the following three action kinds 
(e.g., [28 31 34 J: (i) improvement (modification, upgrade, addition) of a system component, (ii) improve- 



ment of system components compatibility, (iii) change of a system structure. Some applied examples of 
system improvements for modular systems were presented in the following sources: (a) building (e.g., 
[31142] ). (b) information system (e.g., [IB]): (c) human-computer systems (e.g., [31130) ), (d) communica- 
tion protocols and standards (e.g., [43149] ). (e) management system for smart homes (e.g., [41147] ). and 
(f) communication networks (e.g., [34145] ). 

Evidently, detection of system bottlenecks may be considered as a preliminary phase. Fig. 4 depicts an 
illustrative example for a component-based improvement process: S a =>• S b {X\ =► X 2 , Z\ =>■ Z$). 
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Fig. 4. System improvements (by components) 
Table 1. Basic system improvement situation, underlying problems/models 
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2.1.2. System Extension 

Generally, the system extension problem consists in designing an additional system part. Here, three 
basic extension strategies may be considered: 

I. Independent (separated) design. Designing the additional system part. As a result, the new system 
will include two system parts (i.e., initial and additional). 

II. Generalized new design. Designing a new "generalized" system, which involves the initial system 
part and additional system part (integrated design). 

777. Separated design with coordination. Designing the additional system part, modification of the 
initial system part and coordination of initial system part and the new additional system part. 

2.2. Basic System Improvement Situation and Combinatorial Problems 

Table 1 contains a list of basic approaches and corresponding combinatorial optimization problems for 
the considered basic system improvement situation (Fig. 3). 

2.3. Additional System Improvement Situations 

In general, it is reasonable to consider the following additional system improvement situations: 

(a) aggregation: to obtain an improved system as aggregation of several initial systems (Fig. 5) , 

(b) designing a set of improved systems (Fig. 6), 

(c) joint aggregation and designing the set of improved systems (Fig. 7). 

In the case of multi-objective design approaches, designing the set of improved systems may be based 
on obtaining the Pareto-efhcient solutions, which can be considered as the system set. 
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Fig. 5. System improvement as aggregation 




Design of set 

of improved 

systems 



Resultant 
improved 
system 1 




Resultant 
improved 
system m 



Fig. 6. Improvement to design a system set 
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Fig. 7. Aggregation & design of system set 

A recent survey of aggregation approaches to hierarchical modular systems is presented in 36 . In 
the case of multi-objective design approaches, designing the set of improved systems may be based 
on obtaining the Pareto-efhcient solutions, which can be considered as the required system set (e.g., 

I3ll33l36] 1. 



3. Approaches to System Evaluation and Improvement 

3.1. Spaces of System Quality and Improvement 

Generally, system improvement process for composite (modular) systems consists in selection of system 
improvement actions (operations) to obtain increasing a generalized system "utility" (quality, excellence) 
while taking into account a total constraint(s) for costs of the improvement actions. Thus, it is necessary 
to consider the following issues: 



(i) assessment of the system "utility" (a "space" as a scale, multidimensional space, a poset /lattice), 

(ii) cost of the improvement actions, 

(iii) combinatorial improvement problem (e.g., multicriteria selection of the improvement actions, 
knapsack-like problem, combinatorial synthesis as selection and composition of the improvement actions). 

Evidently, special multi-stage system improvement procedures can be considered as well. 

System evaluation approaches include a method to integrate estimates for system components and 
estimates for system component interconnection (compatibility). Table 2 contains the basic approaches 
to evaluation of the total system "utility" (quality, excellence). 



Table 2. Evaluation of total system quality 



Method 



Sources 



1 . "Utility" function for system quality 
(system components are assessed by 
quantitative/ordinal scales) 

2. Multicriteria description for system quality 

3.Poset-like scale for system quality: 
3.1. Ordinal scales for system components 

and for components compatibility 
3. 2. Ordinal scales for system components, 

poset-like scale for components compatibility 
4. Poset-like scale for system quality 

based on interval multiset estimates: 
4.1. Multiset estimates for system components and 

ordinal estimates for components compatibility 
4. 2. Multiset estimates for system components and 

multiset estimates for components compatibility 
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[22I55I57I58J 
[28131137] 



Illustrations for the above-mentioned methods are the following: 

Method 1: scale of system "utility" (Fig. 8), initial system S a is transformed into improved system 
S b where system "utility" is designated as N(S a ) (N(S b )). 

Method 2: multicriteria case (two criteria), ideal point S 1 , four Pareto-efficient solutions (Sf, 5f, 
Sf, Sf ) (Fig. 9), three improvement processes: 

(i) initial system S' is transformed into Pareto-efhcient solution S%, 

(ii) initial system S' is transformed into ideal solution S 1 . 

(iii) Pareto-cfhcicnt solution S% is transformed into ideal solution S 1 . 
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Fig. 8. Scale of "utility", improvement 
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Fig. 9. Multicriteria "utility", improvement 



Method 3: poset-like scales (or lattices) for system quality (case 3.1) (e.g., [28129131137] ). 

Here, Hierarchical Morphological Multicriteria Design (HMMD) approach is used [28131137] . which 
is based on the morphological clique problem. The composite (modular, decomposable) system under 
examination consists of the components and their interconnections or compatibilities. The designations 
are: (1) design alternatives (DAs) for leaf nodes of the tree-like model; (2) priorities of DAs (r = 1, k; 
1 corresponds to the best level); (3) ordinal compatibility estimates for each pair of DAs (w = 0,1; 



I corresponds to the best level). The system consists of design alternatives (DAs) for system parts 
(P(l), ...,P(i), ..., P(m)): S = S{l)-k...-kS(i)-k...-kS(m) of DAs (one representative design alternative 
S(i)), with non-zero pair interconnection (pair compatibility IC) between the selected DAs. A discrete 
space (poset, lattice) of the system excellence on the basis of the following vector is used: N(S) — 
(w(S);n(S)), where w(S) is the minimum of pairwise compatibility between DAs which correspond to 



different system components (i.e., V Pj x and Pj 2 , 1 < j± =/= j'2 < Tn) in S, n(S) = (m, 



■nk). 



where n r is the number of DAs of the rth quality in S Q3 r =i Ur = m )- 

A three-component system S — X *Y * Z is presented as an illustrative example. Ordinal scale for 
elements (priorities) is [1,2,3], ordinal scale for compatibility is [1,2,3]. For this case, Fig. 10 depicts 
the poset of system quality by components and Fig. 11 depicts an integrated poset with compatibility 
(each triangle corresponds to poset from Fig. 10). This is case 3.1. 

Fig. 10 and Fig. 11 illustrate the improvement processes: 

Improvement A: poset-like scale for total quality of system elements, (Fig. 10), initial system S a 
(n(S a ) = (0, 2, 1)) is transformed into improved system (by components) S b (n(S b ) = (2, 0, 1)). 

Improvement B: integrated poset-like scale for total quality of system elements and their compatibility 
(ordinal scale is used for estimates of compatibility ), ideal point S 1 , three Pareto-efhcient solutions ( Sf , 
£f> Sf) (Fig. 11), three improvement processes: 

(a) initial system S' is transformed into Pareto-efhcient solution S%, 

(b) initial system 5" is transformed into ideal solution S 1 , and 

(c) Pareto-efhcient solution 5*3 is transformed into ideal solution S 1 . 

Generally, the following layers of system excellence can be considered: (i) ideal point; (ii) Pareto- 
efhcient points; and (hi) a neighborhood of Pareto-efhcient DAs (e.g., a composite decision of this set can 
be transformed into a Pareto-efhcient point on the basis of a simple improvement action(s) as modification 
of the only one element). The compatibility component of vector N(S) can be considered on the basis 
of a poset-like scale too (as n(S)) f |29l31j ). In this case, the discrete space of system excellence will be 
an analogical lattice. 



<3,0,0>ggg 

1 n{S b 

<2,1,0> / 



<2,0,1 > < 1,2,0> 



Ideal QNiS 1 ) 
point < 



t N(Sf) 



< 1,1,1 > < 0,3,0> 



< 1,0,2> <0,2,1> 



<0,1,2> 



n(S a ) 
Fig. 10. System quality by elements n(S) 



' „ Worst 
< 0,0, 3 > point 





w = 2 
w = 1 
Fig. 11. System quality with compatibility N(S) 



Method 4: In [3S], analogical poset-like system quality domains have been suggested in the case of 
interval multi-set estimates for DAs (or/and for system compatibility). Fig. 12 depicts the poset-like 
scale for the interval multiset estimate (3 position, 3 assessment element). 

This system evaluation case can be used for the previous method 3. On the other hand, this system eval- 
uation approach can be very useful for system improvement by components and system extension. Here, 
the total system estimate (i.e., estimate of system quality) is considered as the following approaches to 
aggregation of interval estimates of system components |38j : (a) an integrated interval multiset estimate, 
(b) median-like interval multiset estimate. 



Fig. 13 depicts an example of this kind of system transformation (reconfiguration): (a) replacement 
of component: X\ =>■ X2, (b) deletion of component: Z\, (c) addition of two-component part: U-kV. 
Interval multiset estimates for system components and for system quality are depicted in parentheses 
(Fig. 13). Median- like interval multiset estimate is used for evaluation of the system quality. 
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3.2. Towards Reoptimization 

In recent several years, a special class of combinatorial optimization problems as "reoptimization" 
has been studied for several well-known problems (Table 3). In general, the reoptimization problem is 
formulated as follows: 

Given: (i) an instance of the combinatorial problem over a graph and corresponding optimal solution, 
(ii) some "small" perturbations (i.e., modifications) on this instance (e.g., node-insertion, node-deletion). 

Question: Is it possible to compute a new good (optimal or near- optimal) solution subject to minor 
modifications ? 



Table 3. Studies of reoptimization 



Combinatorial optimization problem 


Sources 


1. Minimum spanning tree problem 

2. Traveling salesman problems 

3. Steiner tree problems 

4. Covering problems 

5. Shortest common superstring problem 
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A survey of complexity issues for reoptimization problems is presented in [8]. Mainly, the problems 
belong to class of NP-hard problems and various approximation algorithms have been suggested. 

Another approach to modification in combinatorial optimization problems as "restructuring" has been 
suggested in [35] . The approach corresponds to many applied reengineering (redesign) problems in existing 
modular systems. The restructuring process is illustrated in Fig. 14 [35 . Here, modifications are based on 
insertion/deletion of elements (i.e., elements, nodes, arcs) and changes of a structure as well. Two main 
features of the restructuring process are examined: (i) a cost of the initial problem solution restructuring 
(i.e., cost of the selected modifications), (ii) a closeness the obtained restructured solution to a goal 
solution. 
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Fig. 14. Illustration for restructuring process 



The optimization problem is solved for two time moments: n and r 2 to obtain corresponding solutions 
S 1 and S 2 . The examined restructuring problem consists in a "cheap" transformation (change) of solution 

5 1 to a solution S* that is very close to S 2 . In [35], this restructuring approach is described and 
illustrated for the following combinatorial optimization problems: knapsack problem, multiple choice 
problem, assignment problem, spanning tree problems. 

Fig. 15 depicts the restructuring problem [35] . 

Let P be a combinatorial optimization problem with a solution as structure S (i.e., subset, graph), 
f2 be initial data (elements, element parameters, etc.), f(P) be objective function(s). Thus, S(fl) be a 
solution for initial data $7, f(S(£i)) be the corresponding objective function. Let fi 1 be initial data at an 
initial stage, /(S^fi 1 )) be the corresponding objective function, ft 2 be initial data at next stage, f(S(fl 2 )) 
be the corresponding objective function. 

As a result, the following solutions can be considered: (a) S 1 — Stfl 1 ) with /(^(fi 1 )) and (b) 

5 2 = S(fl 2 ) with f(S(ft 2 )). In addition it is reasonable to examine a cost of changing a solution into 
another one: H(S a — > S"). Let p(S a ,S") be a proximity between solutions S a and S" , for example, 
p(S a ,SP) = \f(S a ) — f(S^)\. Note, function f(S) is often a vector function. Finally, the restructuring 
problem is (a basic version): 

Find solution S* while taking into account the following: 

(i) H(S 1 — > S*) — > min, (ii) p(S*,S 2 ) — > min (or constraint). 

Thus, the basic optimization model can be considered as the following: 



mmp(S*,S 2 ) s.t. HiS 1 -^ S*) <h, 



where h is a constraint for cost of the solution change. 

Proximity function p(S* , S 2 ) can be considered as a vector function (analogically for the solution 
change cost). The situation will lead to a multicriteria restructuring problem (i.e., searching for a Pareto- 
efficient solutions). 
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Fig. 15. Illustration for restructuring problem |35j 

4. Improvement by System Components 

4.1. Basic Framework 

Generally, system improvement by components is based on improvement/replacement of system ele- 
ment. The basic framework to system improvement by system components can be considered as follows: 

Stage 1. Detection of system bottlenecks set. 

Stage 2. Generation of system improvement actions (i.e., improvement of DA, improvement of inter- 
connection between DAs) and their assessment. 

Stage 3. Formulation of the system improvement problem as combinatorial optimization problem as 
selection/combination of improvement actions (model: multiple choice problem or HMMD in the case of 
interconnection between the actions). 

Stage 4- Solving the system improvement problem. 

An example of combinatorial synthesis of composite five-component system is presented in Fig. 16. 
Here, HMMD is used (e.g., [28131133157] ). Ordinal quality of DAS are depicted in Fig. 16 (in parentheses, 
scale: [1,2,3,4]). Table 4 contains ordinal compatibility estimates (scale: [0,3]). 
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Fig. 16. Example of system structure 

The resultant composite Pareto-efficient DAs are the following (Fig. 17): 

(a) Sx = X 2 * Yi * Z 2 * Ux * V 2 , N(S X ) = (1; 3, 2, 0, 0) and 

(b) S 2 = X 2 *Yi * Z 3 * U 2 * V 2 , N(S 2 ) = (3; 2, 2, 1, 0). 

Table 5 contains some bottlenecks and improvement actions. Further, it is possible to examine a com- 
binatorial synthesis problem to design a system improvement plan based on the pointed out improvement 
actions (multiple choice problem or HMMD in the case of interconnection between the actions) . 

The improvement procedure based on multiple choice problem for S 2 is considered. It is assumed im- 
provement actions are compatible. Table 6 contains improvement actions and their illustrative estimates 
(ordinal scales). 
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w = 3 
w = 2 
io = 1 
Fig. 17. Poset of system quality 

Table 5. Bottlenecks and improvement actions 



Composite DAs 


Bottlenecks 


Actions 

w/r 


DAs 


IC 


S 2 =X 2 *Y 1 *Z 3 *U 2 *V 4 
S 2 =X 2 *Y t *Z 3 *U 2 * V 4 
S 2 =X 2 *Y 1 *Z 3 *U 2 *V i 
S 2 = X 2 *Y 1 *Z 3 *U 2 * V 4 
S 2 = X 2 *Yn<Z 3 *U 2 * V 2 
S 1 =X 2 *Y 1 *Z 2 *U 1 *V 2 


A 2 

z 3 
z 3 
u 2 
v 2 


(u u v 2 ) 


2^ 1 
3^-2 
3=> 1 
2=S> 1 
2=S> 1 
1=^3 





Table 6. Improvement alternatives 






DA 


Improve- 


Binary 


Cost 


Profit 






ment action 


variable 


a ij 


Cij 


1 


A 2 


None 


Xu 








2 


A 2 


2^ 1 


X\2 


3 


4 


3 


z 3 


None 


X 2 \ 








4 


z 3 


3^2 


X22 


1 


2 


5 


z 3 


3^ 1 


3^23 


5 


4 


6 


u 2 


None 


£31 








7 


u 2 


2=> 1 


£32 


4 


4 


8 


v 2 


None 


£41 








9 


v 2 


2=> 1 


£42 


2 


4 



The multiple choice problem is: 

4 qi 4 <Ji <Ji 

max) ^ N , c ij x ij s -t- /,/, a ij x ij -i &> /, X ij—^ Vi = l,4, Xjj G {0, 1}. 

j=l 3=1 1=1 3=1 3=1 

Clearly, 51 = 2, 92 = 3, (73 = 2, (74 = 2. Some examples of the resultant improvement solutions are (a 
simple greedy algorithm was used; the algorithm is based on ordering of elements by a/ ai): 

(1) b 1 = 1: (xii = 1, £22 = 1, x 3 i = 1, x±i = 1), value of objective function c bl = 2, N(S 2 1 ) — 
(3; 2, 3, 0,0); 

(2) 6 2 = 2: (x u = 1, £21 = 1, 131 = 1, £42 = 1), c bl = 4, N(&) = (3; 3, 1, 1, 0); 

(3) b 3 = 7: (zh = 1, x 23 = 1, 131 = 1, ^42 = 1), c b - = 8, N{Sf) = (3; 3, 2, 0,0); and 



(4)fo 4 = 14: {x 12 = 1, x 23 = 1, x 32 = 1, x i2 = 1), c b * = 16, A(^) = (3; 5,0, 0,0) 



4.2. Graph Vertex Recoloring Problem 

Now, a simplified illustrative version of system improvement by components will be presented as graph 
vertex recoloring problem [33] ■ In recent years, graph recoloring problems have been examined (e.g., 
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[314118151152] ). Here, the basic problem formulation is the following. There are the following: graph 
G = (A, E) (\A\ — n), set of colors X = {xi, ...,Xk}, and initial color configuration for graph G: 
C (G)^_{C°(ai),...,C°(ai),...,C (a n )}, C°( ai )&X Va 4 e A (» = T7H). Let d ai (x Sl ,x S2 ) (& = TTfe, 
5i = l,fc) be a nonnegative recoloring cost matrix for each vertex (i.e., individual recoloring cost 
matrix Va^ e A) . For graph G, a goal co/or configuration C 9 (G) or a set of goal color configurations 
{C 9 (G)} are used as well. Now, for each two color combination (C 1 {G) and C 2 (G)) it is possible to 
consider an integrated cost (the cost of recoloring), e.g., as an additive function D(C 1 (G),C 2 (G)) — 
ST=i < ^a i (G 1 (ai), C 2 (ai)). In addition, it is necessary to consider a proximity of two color configurations: 
p(C^ 1 (G),C^ 2 (G)). Thus, the following transformation chain is examined: 

C°(G = (A,E)) => C*(G = (A,E)) => C 9 (G = (A,E)) 

where C*(G = (A, E)) is a resultant color configuration. 

Generally, it is reasonable to examine two generalized objectives: (i) the cost of transformation 
C°{G) => C*(G) and (ii) the quality of proximity between C*{G) and C 9 {G) (or {C 9 (G)}). Assessment 
of the cost and proximity above can be based on various approaches (e.g., additive function, minimization, 
'min/max' function, vector function). 

Now, the basic problem of graph recoloring can be considered as follows: 

Find the new color configuration C* (G) for a given graph G = (A, E) to minimize the proximity 
of the resultant graph coloring configuration C*(G(A, E)) to the goal coloring configuration of graph 
C 9 (G(A,E)) while taking into account the limited integrated cost of the recoloring (< D): 

min p(C*(G),C 9 (G))) 
{C(G=(A,E))} 



s.t. D(C°(G),C*(G))<D, C*(a,)^C*(a J -)V(a i ,a i )e^ ! i?j. 

Fig. 18 illustrates the graph (vertex) recoloring problem: 
C°(G) = (P2*Q3*U 3 *V2*W 1 ) => C*(G) = {P 1 *Q2*U 2 *V 1 *W 3 ) 




Initial 
coloring 



Example of vertex recoloring 



5. Modification of System Structure 

Modification of system structures is a crucial and complex combinatorial problem: 

Initial system structure =^- Modification process => Final system structure 

Table 7 contains a list if basic problems, which are targeted to modification of structures. 
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Table 7. Modification of structures 



Problem 


Initial structure 


Resultant structure 


Source 


1. Modification of tree-like 
structures: 

l.l.Hotlink assignment 
problems 

1.2. Modification of tree via 
condensing weighted vertices 

1.3. Transformation of tree 
into Steiner tree 

2. Transformation of morpho- 
logical structure 

3. Transformation of layered 
structure 

4.Augmenation problem 


Tree-like structure 
Weighted tree 

Tree 

Morphological 
structure 
Layered structure 

Connected graph 


Tree-like structure with 
additional link from root 
Weighted tree with 
aggregated vertices 
Steiner tree 

Morphological structure 
with required properties 

Layered structure with 
required properties 

Connected graph with 

required properties 

(e.g., increased connectivity) 




[10111116] 
[19124140] 
[26128140] 


(40146148] 


(28131140] 


|14|23| 



5.1. Modification of Tree-like Structures 
5.1.1. Hotlink Assignment Problems |40j 

In general, "hotlink assignment problem" is a network upgrade problem (e.g., 



.): 



Find additional new arc(s) to the initial graph in order to insert shortcuts and decrease the expected 
path length. 

Mainly, the problem is examined for trees. Let T = (A, E) be a directed tree with maximum degree d, 
rooted at a node r G A (elements of A correspond to Web sites, elements of E correspond to hyperlinks). 
A node weight equals its access (search) frequency (probability). It is assumed that required information 
is contained at leaf nodes (for simplicity). The length of the search for node »6i equals the number of 
links in the path from ro to «. 

Let T u — (A Ul E u ) be a subtree of T {A u C A,E U C E), rooted at node u £ A (here u is not the son 
of ro). Thus, additional direct link ("hotlink") will be as follows: (ro,u). In this case, a path to all leaf 
nodes in T u will be smaller. 

Fig. 19 illustrates the simplest version of "hotlink assignment" problem. 




Fig. 19. Hotlink assignment problem (one hotlink) 



Some versions of the problem are presented in Table 8. Mainly, "hotlink assignment" problems belong 
to class of NP-hard problems (e.g., Q35]). Many approximation algorithms have been suggested for the 
problems (including FPTAS) (e.g., [24 50 ). 



14 



Table 8. Hotlink assignment problems 



Problem 


Source 


1. Basic hotlink assignment 
2. Single hotlink assignment 
3.Hotlinks only for leafs 
4. Multiple hotlink assignment 
5. Dynamic hotlink assignment 


[lf)l56] 
[12124] 

19 

[hub] 



5.1.2. Modification of Tree via Condensing of Weighted Edges [26,28.40] 

This section describes briefly transformation of a tree (with weights of vertices and weights of edge/arcs) 
via integration (condensing) of some neighbor vertices while taking into account a constraint for a total 
weight of the maximum tree tail (i.e., length from root to a leaf vertex). The problem was firstly 
formulated for designing an overlay structure of a modular software system in [26]. The integration of 
software modules requires additional memory, but allows to decrease a time (i.e., frequency) of loading 
some corresponding modules. Other applications of the problem can be examined as well, e.g., hierarchical 
structure of data, call problem, hierarchical information structure of Web-sites. This problem is illustrated 
in Fig. 20 and Fig. 21 by an example for designing the over-lay structure on the basis of module 
integration, when different software or data modules can apply the same parts of RAM. A new kind of 
FPTAS for the above-mentioned combinatorial optimization problem (a generalization of multiple choice 
problem over a tree- like structure and special constraints) was suggested in [26] . 




6 / 7\ 8/ 91io\ \13 
Fig. 20. Integration of software modules (over-lay structure) [40] 
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Fig. 21. Usage of memory (RAM) [40] 



5.1.3. Transformation of Tree into Steiner Tree |40] 

Recently, two multicriteria problems for transformation of a tree into Steiner tree have been examined: 
(1) multicriteria problem for transformation of an initial tree into Steiner tree |46) and (2) multicriteria 
problem for transformation of an initial tree into Steiner tree while taking into account a cost of Steiner 
vertices [35]. Here, the transformation of a tree T — (A,E) into Steiner tree S — (A',E') is considered 
as addition of Steiner points into an initial tree (or a preliminary built spanning tree) while taking into 
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account the following: "cost" (required resource) of each Steiner point, generalized "profit" of each Steiner 
point, total resource constraint (i.e., total "cost" of the selected Steiner points). The material is based 
on [40) . A simplest case is considered when Steiner points for triangles are only examined. Evidently, 
vector-like "cost" and "profit" can be used as well. The solving scheme is the following: 

Stage 1. Identification (e.g., expert judgment, clustering) of m regions (clusters, groups of neighbor 
nodes) in the initial tree T for possible addition of Steiner points. 

Stage 2. Generation of possible Steiner points (candidates) and their attributes (i.e., cost of addition, 
"profit"). 

Stage 3. Formulation of multiple choice problem for selection of the best additional Steiner points 
while taking into account resource constraint (s): 



m qt 

max 2_. / c-ijXi 



m qi 



■t. ^2^2a,ijXij <b, y^a?jj = 1, Xij € {0, 1}; 



i=i j=i 



j=i 



where i is the index of region (i = l,m), Qi is the number of versions for addition of Steiner points in 
region i = 1, m, j is the index of version for addition of Steiner points in region (J — 1, qi ), Xij is binary 
variable that equals 1 if version j in region i is selected, & is a total constraint for the required resources 
(i.e., a total "cost"). 

Stage 4- Solving the multiple choice problem to obtain the resultant Steiner tree S. 

A numerical illustrative example illustrates the scheme. Initial tree is (Fig. 22): T = (A,E), A = 
{1,2,3,4,5,6,7,8,9,10,11}. Four regions are defined (Fig. 22): region 1: {1, 2,3,4}; region 2: {4,6,7}; 
region 3: {4,5,6,9,11}; and region 4: {7,8,10}. The considered Steiner points are the following (Fig. 
22): region 1: Sn,si2; region 2: S21; region 3: 831,832; and region 4: S41. Table 9 contains initial data 
for multiple choice problem: binary variables and corresponding attributes (required resource as "cost" , 
possible "profit"). The corresponding multiple choice is: 



4 q t 



4 g, 



t. ^^a i:j x i: j < b, ^Xij = 1, Xij E {0,1}. 

i=l 3=1 j=l 



An obtained solution (i.e., as set of additional Steiner points) is the following (a simple greedy heuristic 
was used) (Fig. 22): b\ = 2.9; X\, x \ X\i — 1, 2:21 = 1, £32 = 1, *4i = 1, Steiner points Zb 1 — {sn, S31}, 
total (additive) "profit" c = 5.5. 



Initial tree T 
1- -2 




Region 1 



Steiner points 
for regions 1, 3 




Region 4 



Fig. 22. Initial tree, regions (clusters), Steiner tree 
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Table 9. Data for multiple choice problem 



Region 




Binary 


Steiner 


"Cost" 


"Profit" 






variable 


point 


Cij 


a ij 


Region 


1 


x n 


None 


0.0 


0.0 






*12 


Sll 


3.1 


1.5 






£13 


S12 


1.2 


1.4 


Region 


2 


£21 


None 


0.0 


0.0 






£22 


S21 


2.0 


1.3 


Region 


3 


£31 


None 


0.0 


0.0 






£32 


S31 


2.4 


1.4 






£33 


S32 


1.8 


1.3 


Region 


4 


£41 


None 


0.0 


0.0 






£42 


S41 


1.5 


1.2 



5.2. Augmentation Problem 

Graph augmentation problem is a generalization of "hotlink assignment" problem (e.g., }14|23j ). The 
goal is to modify an initial graph/network (e.g., by edges) such that the augmented graph will by satisfied 
some requirements (e.g., as increasing the connectivity). 

5.3. Transformation of Morphological Structure 

Morphological system structure was suggested for the extended version of morphological analysis 
(HMMD) and contains the following parts (e.g., [28 31 36 37 40 ): (1) system hierarchy (e.g., a tree) 
(2) set of leaf nodes (i.e., system components), (3) sets of alternatives (DAs) for each system component; 
(4) estimates of the alternatives (ordinal as priority, interval, etc.), (5) compatibility estimates for alter- 
native pairs. A numerical example of the morphological system structure was presented in Fig. 16 and 
Table 4. In general, the system morphological structure and its transformation are depicted in Fig. 23: 
S' => S". Here, the following is transformed: 

(a) system hierarchy (tree) T" =>• T", 

(a) basic system components as leaf nodes L' — {1, ..., i, ..., m'} =>• L" = {1, ..., i, ..., to"}. 

The numerical example of system structure transformation (as system reconfiguration) was described 
in section 3.1 (Fig. 13). 



System S' 



System S" 




.Alter- 
natives 




.Compati- 
bility 

Fig. 23. Morphological system structure, its transformation 



5.4. Transformation of Layered Structure 

The multilayer system structure is examined as follows: (a) set of layers, (b) for each layer: 
nodes, topology over the nodes, (c) connection of nodes for neighbor layer. 

Thus, the modification process of the layered structure can involve the following: 



set of 
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1. Modification of the layer-structure: (1.1) Addition of a layer, (1.2) Deletion of a layer. 

2. Modification of a layer: (2.1) addition of layer nodes, (2.2) deletion of layer nodes (2.3) modification 
for the layer topology (a network over the layer nodes) . 

3. Modification of inter-layer connections (i.e., connection for nodes of neighbor layers): reassignment. 
Fig. 24 depicts the modification process 5" =>■ S". 

A numerical example for two-layered network will be presented later (extension of layers, reassignment). 

Multilayer system S' 
(Layer nodes L' t = {1, ...,m' t f) Top => Multilayer system S" 



SH '•• M\ J *° Z (~^V 

Connection for nodes ± 71 I JIj 

of neighbor layers r _ 

( Layer nodes L\ = {1, ..., m$) J^er, f Layer nodes L'[ = {1,. . . , to'/} 



Layer nodes Ll = {1, ..., m' b } \ Bottom [Layer nodes L'l = {1, ..., mi'}) 

• • ... • • ; layer V • • • • • • • J 



layer 
Fig. 24. Transformation of multilayer structure 

6. Examples for Network Improvement/Extension [34j 

6.1. Network Hierarchy 

A traditional network hierarchy can be considered as follows (e.g., [25 53 59 ): (a) international (multi- 
country, continent) network GAN; (b) metropolitan network MN; (c) wide area network WAN; and (d) 
local area network LAN. From the "engineering" viewpoint, hierarchical layers involve the following: (i) 
backbone network; (ii) global network as a set of interconnected network segments (including additional 
centers, cross-connections, and bridges); (iii) access network/network segment (cluster): bi-connected 
topology (about 20 nodes); and (iv) distributed network (a simple hard topology, e.g., bus, tree, ring). 

A simplified example of a three-layer network hierarchy is the following: (a) "center" systems (e.g., 
hubs), (b) access points, and (c) distributed networks. 

6.2. Requirements/Criteria 

Contextual classification of the requirements to communication networks is considered as follows (e.g., 
[25134] ): (1) "user" requirements: cost, time characteristics, quality (information errors, reliability of 
connection); (2) system requirements: cost, reliability (or stability, redundancy, k-connectivity), manage- 
ability, maintainability, testability, modularity, adaptability, safety, and flexibility (e.g., reconfigurability) ; 
(3) mobility requirements; and (4) system evolution/development requirements: possibility for re-design 
(upgradeability) . 

On the other hand, it is possible to consider a correspondence of the requirements to network hier- 
archical layers, for example: (1) top layer: cost, safety (stability, reliability, redundancy, survivability), 
manageability, adaptability, flexibility, upgradeability; (2) medium layer: basic quality, reliability, and 
survivability; (3) bottom layer: basic quality (time, cost, etc.) and reliability. 

6.3. Network Design/Development: Basic Problems 

In Table 10, some basic problems are pointed out from the viewpoint of network layers and two types 
of activities: network design and network improvement/extension. 

Thus, underlaying combinatorial optimization problems (e.g., minimum spanning tree, minimum Steiner 
tree, covering, design of a k-connected topology, location/placement of network nodes, selection of some 
additional links as additional network edges, selection and location of additional network nodes) can 
be considered. In the numerical examples, the following combinatorial problems are used: (1) multiple 
criteria ranking (e.g., |28|39|57j ). here our modification of outranking technique (Electre-like method) is 
used [39] ; (2) clustering (e.g., [20]), here our modification of agglomerative algorithm is used [32]; (3) 
assignment/allocation problem (e.g., [H]), here our heuristic is used [H]; and (4) multicriteria multiple 
choice problem, (e.g., |17I21| . here our heuristic is used [45] . 
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Table 10. Network layers and design 


/improvement problems 


Network layer 


Some basic structural 


Basic network improvement/ 




design problems 


extension design problems 


System of hubs 


Network topology design: 


(1) addition of hub(s) 


(centers) 


(a) clustering 


(center (s)) 




(b) spanning tree/forest 


(2) addition of links 




(c) Steiner tree 


(e.g., bridge(s)) 




(d) k-connected network 


(3) redesign of network 




(e) covering problem 


topology 


Network over 


Network topology design: 


(1) addition of access 


gateways 


(a) clustering 


point (s) 




(b) spanning tree/forest 


(2) addition of links 




(c) Steiner tree 


(e.g., bridge(s)) 




(d) k-connected network 


(3) redesign of network 




(e) covering problem 


topology 


Access network 


Network topology design: 


(1) addition of access 




(a) clustering 


point (s) 




(b) spanning tree/forest 


(2) addition of links 




(c) Steiner tree 


(e.g., bridge(s)) 




(d) 2-connected network 


(3) redesign of network 




(e) covering problem 


topology 


Distributed 


Last mile problem: 


(1) addition of user(s) 


network 


(a) choice of topology 


(2) addition of distributed 




(b) choice of connection 


network(s) 




(c) choice of access point 





6.4. Network Improvement 

Here, a simplified example for improvement of Moscow phone network (at a macro level) is examined 
[34] . Table 11 contains the considered Moscow regions {Ay,...,Ag} and their estimates upon parameters 
(expert judgment, ordinal scale [1,10]): population Pi, level of an existing communication infrastructure 
Pi , and volume of the region array P3 . 



Table 11. Regions, their estimates 





Region 


Par 


ameters 


-Pi 


P2 


P3 


Ay 


Central 


10 


10 9 


A 2 


South 


8 


9 10 


A 3 


South-west 


G 


7 4 


A± 


South-east 


3 


8 8 


A 5 


North 


4 


4 5 


A e 


North-east 


1 


1 9 


A 7 


North-west 


4 


5 4 


A s 


West 


5 


6 4 


A 9 


East 


2 


4 5 



After clustering (hierarchical clustering is used [32]), the following clusters are obtained: G 1 = {Ai}, 
G 2 = {A 2 }, G 3 = {A 3 ,A 8 }, G 4 = {Ai}, G 5 = {A 5 ,A 7 ,A 9 }, and G 6 = {A 6 }. Table 12 contains 
five development/improvement actions at the region level {Di, Di, D3, D4, D§} (D± corresponds to a 
case when activities are absent). The actions are evaluated upon criteria (ordinal scale [0.5], expert 
judgment): generalized profit (Gi), complexity (G2), perspective profit (G3), and expenditure (G4). 
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Table 12. Development/improvement actions 





Development action 


Criteria 


Cx 


c 2 


C z 


c A 


Di 

D 2 
D 3 
D 4 

D 5 


None 
New links 
Reparation of links 
Extension (new links 
and devices) 
Deletion of old links 



5 

2 
3 

1 




5 
2 
3 

1 



5 5 

2 2 

3 3 

1 1 



Fig. 25 depicts a two-stage solving scheme. A composite development plan is based on the following 
multcriteria multiple choice problem (a simplest greedy-like heuristic is used): 



6 5 

max EE c y 



min J2J2 c t 



6 5 

max I]XX- 

i=\ j=l 



6 5 

min J2J2 c i 



6 5 5 

i=l .7=1 j = l 



1» = 1,6, i !3 €{0,1}. 



As a result, the following solution is obtained: Si =< D4 * D| * Df * Df * D\ * Df >. In the case of 
interconnections of solutions for neighbor regions, it is necessary to use combinatorial synthesis based on 
HMMD |28l31l37l38] . 

Regions 
and clustering 



® 

® 

^A 5 ,A 7 ,A 9 

A. 



Composite development plan 
Example: S' = 

< Dl * D\ * Df • D| * D\ * D? > 



Dj D? D? Df D^ (£>D 
D* D 2 2 @ D| D\ D\ 

Dl @ D| D| Dl D| 



Dl 



Di 



Dl 



Di 



Fig. 25. Illustration for two-stage scheme [34] 



6.5. Network Extension 

Here, an applied example for a regional communication network is considered: (i) there exists a 
communication network for a region, (ii) it is needed to design an additional communication network for 
a neighbor region. Three extension strategies may be considered: 

Strategy I. Designing the additional communication network (i.e., definition of possible positions for 
communication facilities, location of communication devices, definition of system modes, etc.) and syn- 
thesis of the obtained two networks. 

Strategy II. Designing a new "generalized" communication network for an integrated region (i.e., the 
previous region and the additional regions, integrated design). 

Strategy III. Designing the additional communication network for the neighbor region and modification 
of the communication network for the previous region as coordination between the network for previous 
region and neighbor regions (e.g., reconfiguration, replacement of communication nodes, re-linking). 

Note, the network extension approaches can be used for various hierarchical layers of a communication 
network. 
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Now, two extension strategies above at the layer of connection between users and access points (i.e., 
assignment of users to access points) are examined. Two regions (including users and access point) are 
considered: (i) initial regions (17 users and 3 access points, Table 13 and Table 14, Fig. 26) and (ii) 
additional regions (11 users and 3 access points, Table 13 and Table 14, Fig. 27). Two extension design 
strategies are considered: strategy I (separated design for initial region and for additional region) and 
strategy II (integrated design) . 

For the initial region, the following parameters are used: set of users ^f — {1, ...,i, ...,n} (n = 17), set 
of access points = { 1 , . . . , i, . . . , m} (m = 3). Each user is described by parameter vector (#» ,y%,Zi, fi,Pi), 
where vector components are as follows (Table 4): coordinates of user {xi,yi,Zi, required frequency 
bandwidth /; (scale: 1 Mbit/s ... 10 Mbit/s), priority pi (ordinal scale [1,2,3], all user requirements 
are satisfied in case pi = 1), required reliability r* (ordinal scale [1,10], 10 corresponds to maximum 
reliability). Analogically parameters of access points are considered (by index j, Table 5) including 
parameter rij (maximal possible number of users under service) . 



Table 13. Data for initial region 
(a) users (b) access points 



i 


Xi 


Vi 


Zi 


fi 


Pi 


n 


3 


Xj 


Vi 


*i 


fi 


n 3 


r i 


1 


30 


165 


5 


10 


2 


5 


1 


50 


157 


10 


30 


4 


10 


2 


58 


174 


5 


5 


1 


9 


2 


72 


102 


10 


42 


6 


10 


3 


95 


156 





6 


1 


6 


3 


45 


52 


10 


45 


10 


10 


4 


52 


134 


5 


6 


1 


8 




5 


85 


134 


3 


6 


1 


7 




6 


27 


109 


7 


8 


3 


5 




7 


55 


105 


2 


7 


2 


10 




8 


98 


89 


3 


10 


1 


10 




9 


25 


65 


2 


7 


3 


5 




10 


52 


81 


1 


10 


1 


8 




11 


65 


25 


7 


6 


2 


9 




12 


93 


39 


1 


10 


1 


10 




13 


172 


26 


2 


10 


2 


7 

















Thus, each pair "user-access point" (i.e., (i,j),i G ^,j G 0) can be described: (1) reliability r^ = 
min{ri,rj}, (2) distance Uj 1 (3) priority pij = Pi, and (4) required bandwidth fy — fi. In addition, 
a "connectivity" parameter is considered: fiij equals 1 if l+j < I and otherwise (L corresponds to 
distance constraint). This parameter defines Vi G ^ a subset of possible access points 0, C 0. The 
assignment of user i to access point j is defined by Boolean variable iy (x^ = 1 in the case of assignment 
i to j and x%j — otherwise). Thus, the assignment solution (\[/ => 0) is defined by Boolean matrix 

Finally, the problem formulation is the following: 



X = 



''..; I 



i = 1, n, j = 1, m. 



max) y rijXi 
i=i jeO; 



i=\ je&i 



max^ y^ PijXi 



s.t. ^ fij x i] ^ fi ^3 G 0, J^ Xij < Hj Vj G 0, ^ x ii < 1 Vi G *, 



x^ G {0, 1}, V i = 1, n, V j = 1, to, x^ =0, V % = 1, n, j G {0 \ 0j}. 

Here, a simplified two-stage heuristic used: (i) transformation of vector estimate for each pair (i,j) into 
an ordinal estimate (by multicriteria ranking, ELECTRE-like technique), (ii) solving the obtained one- 
criterion assignment problem (by greedy algorithm). Thus, Fig. 26 depicts the obtained solution: an 
assignment of users to access points. 

Fig. 27 depicts two regions: initial region, additional region, and corresponding assignment of users to 
access points. Here the assignment problems are solved separately for the initial region (assignment from 
Fig. 26) and for the additional region (i.e., strategy I). 
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Fig. 26. Initial region [34] 

Table 14. Data for additional region 
(a) users (b) access points 
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Fig. 27. Two regions: separated assignment [34] 
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Fig. 28 depicts the results of integrated (joint) design strategy IT). Note, the following users are re- 
assigned: 3, 13, and 25. Generally, it may be reasonable (to decrease the dimensions of the problems 
under the solving process) to consider the following approach: (a) design (assignment) for the initial 
region, (b) design (assignment) for the additional region, (c) re-design (re-assignment) for users which 
belong to a border subregion, e.g., in the example (Fig. 27, Fig. 28) the user set involves the following 
users: {3,5,8,13,14,17,21,25}. 




lll§) 12 
Fig. 28. Two regions: joint assignment 



7. Conclusion 

The paper describes combinatorial approaches to system improvement/extension of modular sys- 
tems. Basic system improvement/extension actions are described (e.g., improvement /replacement of sys- 
tem components, improvement/modification of system structure) and composite improvement/extension 
strategies. The described methods are based on combinatorial optimization problems (knapsack prob- 
lem, multiple choice problem, assignment/allocation problem, spanning problems, hotlink assignment 
problem, etc.). Realistic numerical examples illustrate the described strategies. 

In the future, it may be reasonable to consider the following research directions: (1) examination of 
various real- world applications, (2) examination of multi-stage system improvement /extension strategies, 
(3) special study of improvement /extention strategies for problem solving frameworks (e.g., [39) ). (4) tak- 
ing into account uncertainty, (5) special study of reoptimization/restructuring approaches, and (6) usage 
of the described system approaches in education (computer science, engineering, applied mathematics). 
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